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ADAPTIVE FILTER FOR 
NETWORK ECHO CANCELLATION 

FIELD OF THE INVENTION 

This invention relates generally to the field of signal processing and in particular 
to adaptive filtering, specifically that which is well suited for network echo cancellation 
applications in a telephone network. 

BACKGROUND OF INVENTION 

Adaptive filters operate on a supplied signal in a prescribe manner such that a 
desired output signal is generated. Typically, adaptive filters generate a transfer function 
according to an algorithm that includes updating of the transfer function characteristic in 
response to an error signal. In this manner, the filter characteristic is optimized to 
produce a desired result. 

When used in an echo canceller, an adaptive filter is used to generate an echo path 
estimate that is updated in response to an error signal. Echoes commonly occur because 
of imperfect coupling of incoming signals at the 4-to-2 wire junctions in communications 
systems. The echoes typically result because the impedance of the 2-wire facility is 
imperfectly balanced in the 4-to-2 wire junction, causing the incoming signal to be 
partially reflected over an outgoing path to the source of incoming signals. 

Adaptive echo cancellers have been employed to mitigate the echoes by adjusting 
the transfer function (impulse response) characteristic of an adaptive filter to generate an 
estimate of the reflective signal or echo and, then, subtracting it from the outgoing signal. 
The filter impulse response characteristic and, hence, the echo estimate is updated in 
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response to continuously updated samples of the outgoing signal for more closely 
approximating the echo to be cancelled. 

Additionally, double talk detectors (DTD) are generally used to disable adaptation 
during double talk conditions, that is when both the near end and far end party to a 
telephone conversation taking place across a telephone line speak simultaneously. 
Because the double talk detector cannot disable adaptation at the precise instant the 
double talk occurs, a number of samples occur in the delay period between the 
commencement of actual double talk and the double talk detector shutting down 
adaptation. Samples taken during this delay period can and often do perturb the echo 
path estimate considerably. Also, characteristic changes in the system due to 
environmental or other causes can also perturb the filtering. 

Thus, although prior art arrangements of adaptive filters perform satisfactorily in 
some applications, often it is impossible to simultaneously achieve both sufficiently fast 
response and the ability to resist perturbations caused by samples occurring prior to the 
cessation of adaptation. 

SUMMARY OF THE INVENTION 

The present invention overcomes shortcomings in the prior art. Specifically, the 
present invention is based upon a recognition that fast converging algorithms such as 
normalized least mean squares (NLMS), proportional normalized least mean squares 
(PNLMS) and a version which combines the two, specifically PNLMS++, are insufficient 
of themselves to resist perturbations in the echo path estimate resulting from disruptive 
samples collected in the echo canceller prior to the cessation of adaptation by the double 
talk detector. In addition to the fast conversion algorithms just discussed, there is 
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another, known an affine projection algorithm (APA). In one inventive aspect of the 
present invention, a proportional affine projection algorithm (PAPA) is presented which 
combines APA and PNLMS++. This algorithm converges very fast, and unlike 
PNLMS++, is not as dependent on the assumption of a sparse echo response. 

Yet, all of the above fast converging algorithms can benefit from improved 
robustness so as to yield the desired result of fast convergence while at the same time 
achieving decreased sensitivity to near-end disturbances. To that end, the present 
invention incorporates the addition of an adaptive, scaled non-linearity to the echo 
canceller to improve its robustness, that is its resistance to near-end disturbances. The 
adaptive scaled non-linearity, which improves robustness, may be combined with any of 
the aforementioned fast converging algorithms. This yields robust versions of the 
algorithms that when applied by appropriate system components results in a filter that can 
be used in an echo canceller and that maintains good convergence rates for the echo 
canceller while decelerating the divergence due to undetected double talk. 

Other objects and features of the present invention will become apparent from the 
following detailed description, considered in conjunction with the accompanying drawing 
figures. It is to be understood, however, that the drawings, which are not to scale, are 
designed solely for the purpose of illustration and not as a definition of the limits of the 
invention, for which reference should be made to the appended claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

In the drawing figures, which are not to scale, and which are merely illustrative, 
and wherein like reference numerals depict like elements throughout the several views: 
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FIG. 1 is a simplified block diagram of an echo canceller suitable for utilizing the 
proportional affine projection algorithm (PAPA) disclosed herein; 

FIG. 2 is a detailed block diagram showing the block diagramatic representation 
of where in the echo canceller of the present invention the scaled non-linearity device 
should be inserted; 

FIG. 3 is an alternative representation of the echo canceller of the present 
invention; 

FIG. 4 is a graphical representation of a preferred scaled non-linearity which may 
be applied to the echo canceller of the present invention to improve robustness thereof; 

FIG. 5 is a tabular example of the computational requirements for the scaled non- 
linearity; 

FIGS. 6a and b are graphical representations of the impulse response and 
magnitude of the frequency response, respectively, of an exemplary hybrid utilized for 
performance simulations of the present invention; 

FIG. 7 is a group of graphs indicating performance results of a first embodiment 
of the present invention; 

FIG. 8 is a further group of graphs indicating performance results of the first 
preferred embodiment of the present invention; 

FIG. 9 is a further group of graphs indicating performance results of the first 
preferred embodiment of the present invention; 

FIG. 10 is a further group of graphs indicating performance results of the first 
preferred embodiment of the present invention; 
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FIG. 1 1 is a further group of graphs indicating performance results of the first 
preferred embodiment of the present invention; 

FIG. 12 are graphical representations of divergence and convergence comparisons 
utilizing differing algorithms in a first embodiment of the present invention; 

FIG. 13 are further graphical representations of divergence and convergence 
comparisons utilizing differing algorithms in a first embodiment of the present invention; 

FIG. 14 is a further group of graphs indicating performance results of the first 
preferred embodiment of the present invention; 

FIG. 15 is a group of graphs indicating performance results of a second 
embodiment of the present invention; 

FIG. 16 is a group of graphs indicating performance results of a second 
embodiment of the present invention; 

FIG. 17 is a group of graphs indicating performance results of a second 
embodiment of the present invention; 

FIG. 18 is a group of graphs indicating performance results of a second 
embodiment of the present invention; 

FIG. 19 is a group of graphs indicating performance results of a second 
embodiment of the present invention; 

FIG. 20 is a group of curves depicting the impulse response and corresponding 
magnitude of frequency responses for three alternate test hybrid configurations used in 
performing tests on the second embodiment of the present invention; 

FIG. 21 is a group of graphical representations of the signal utilized for a test 3 A 
performed on a second embodiment of the present invention; 
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FIG. 22 is a group of graphs indicating performance results of a first test 
performed on a second embodiment of the present invention; 

FIG. 23 is a further group of graphs indicating performance results of a first test 
on a second embodiment of the present invention; 

FIG. 24 is a further group of graphs indicating performance results of a first test 
on a second embodiment of the present invention; 

FIG. 25 is a further group of graphs indicating performance results of a first test 
on a second embodiment of the present invention; 

FIG. 26 is a further group of graphs indicating performance results of a first test 
on a second embodiment of the present invention; 

FIG. 27 is a group of graphical signal representations for a group of signals used 
for a second test of a second embodiment of the present invention; 

FIG. 28 is a group of graphs indicating performance results of a second test 
performed on a second embodiment of the present invention; 

FIG. 29 is a further group of graphs indicating performance results of a second 
test performed on a second embodiment of the present invention; 

FIG. 30 is a further group of graphs indicating performance results of a second 
test performed on a second embodiment of the present invention; 

FIG. 31 is a further group of graphs indicating performance results of a second 
test performed on a second embodiment of the present invention; and 

FIG. 32 is a further group of graphs indicating performance results of a second 
test performed on a second embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

With initial reference to FIG. 1, which is a schematic diagram of a preferred echo 
cancelling system in accordance with the present invention, there is shown, in a dashed 
line box, an echo canceller 1 forming a part of a network telephone circuit 400 which is 
connected via digital-to-analog (D/A) converter 90 to an analog hybrid 100 which 
connects, via local loop 110, to a telephone line or other telephone instrument 120 at a 
near end 500 in a manner known in the art. Communications from the near end pass 
through local loop 1 10 and through hybrid 100 through an analog-to-digital converter 98 
for communication to a far end, represented generally at 200. Situated across the network 
circuit, in parallel to the hybrid 100, is a fast impulse response (FIR) filter 10 connected 
through summing node 20. In a manner known in the art, fast impulse response filter 10 
attempts to duplicate the impulse response of any discontinuity at the hybrid connection 
point, thereby cancelling echoes. Fast impulse response filter 10 is an adaptive filter 
which receives its filter coefficients, at each sample interval, from coefficient vector 
update device 40. Coefficient vector update device 40 receives as it input an echo signal 
e n , which is a residual echo signal, a step size variable |i, 42, which, in a manner known 
in the art, effects the speed of convergence, and an excitation signal x n generally received 

from the far end 200. 

A double talk detector 30 is also part of echo canceller 1 for controlling 

coefficient vector update device 40 by deactivating coefficient vector update device 40 

during the occurrence of double talk. This effectively halts the adaptation taking place in 

fast impulse response filter 10. There is, however, a finite time delay between the actual 

onset of double talk and the effective discontinuation of adaptation in fast impulse 
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response filter 10. Thus, while it is the goal of double talk detector 30 to in effect 
disconnect coefficient vector update device 40 from the circuit upon the detection of 
double talk, typically by setting the step size 42) to zero, in actuality instantaneous 
response is presently unobtainable. Thus, the finite time that the double talk detector 30 
needs to detect double talk is often enough to misalign the filter coefficients of coefficient 
vector update device 40 considerably. In other words, even a small error in the double 
talk detector 30 leads to relatively large errors in the adaptive coefficients provided to fast 
impulse response filter 10 by coefficient vector update device 40. Thus, the samples of 
echo signal e n obtained in coefficient vector update device 40 during the period of 
undetected double talk leads to significant misalignment of fast impulse response filter 10 
which, upon activation of double talk detector 30 and the discontinuance of adaptation, 
remains frozen in a significantly non-adapted or divergent state. Under such 
circumstances, effective suppression of residual echo cannot be obtained. 

Thus, in order to render echo canceller 1 more robust, that is more able to 
decelerate the divergence due to undetected double talk while maintaining good 
convergence for the echo canceller, an adaptive scaled non-linearity device 50, as seen in 
FIG. 2, is inserted in echo canceller 1 for application of an adaptive scaled non-linearity 
to error signal e n so as to reduce the impact of undetected double talk while maintaining 
fast convergence. With reference to FIG. 4, which will be discussed further below, a 
preferred adaptive scaled non-linearity 300 is graphically depicted. 

With reference now to FIG. 3, there is shown an alternate representation of echo 
canceller 1 in accordance with the present invention showing double talk detector 30 
controlling coefficient vector update device 40 which generates filter coefficients for use 


772508 


BENESTY 2-1-6-13 

by fast inpulse response filter 10 by utilizing an adaptive algorithm incorporating the 
adaptive scaled non-linearity (e.g. FIG. 4) fed by adaptive scaled non-linearity device 50.. 
True echo path 12 is representationally shown connected to the echo canceller through a 
representational summing node 22, at which point v n is shown as an input signal which 
includes background noise and possibly near-end signals from near end 500. 

As mentioned above, it is preferable for the coefficient vector update device 40, 
which provides the adaptive filter coefficients utilized by the adaptive filter FIR 10, to 
provide for fast convergence through the use of fast converging algorithms. As used 
herein, the term coefficients of the adaptive filter, adaptive filter weights, filter taps and 
taps weights, shall be used interchangeably. Further, the following notations will be used 


consistently throughout herein: 

x n = Far-end signal, (1) 

v n = Background noise and possibly near-end signals, (2) 

yn = Echo and background noise possibly including (3) 
near-end signal, 

Y n = \y n - ■ • yn-p+lf. Vector of samples y n (4) 

x n = [x n . . . x n -L+l] T , Excitation vector, (5) 

X n = [x n . . . x n -p-hj], Excitation matrix, 
(6) 

hp ^ [h 0 > - • - ^Z-/] T , True echo path, (7) 

h n = [h0 } n>* • * s ^Z-7,/?] T ? Estimated echo path, (8) 

A A A 

hn = [ho,rb->h L-l,n\ T > A* 1 alternative coefficient (9) 
vector for fast APA, 

e n = yn-K x n> Residual echo, (10) 
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e n = Y n 'X r n h n? Residual echo vector, (11) 
zi y n = zth element in any arbitrary vector z n . (12) 
As used herein, L is the adaptive filter length and p is projection order of the APA. 
As discussed further below, only the preferred exemplary projection order p = 2 is 
considered, it being recognized by the person of skill that other projection orders may be 
considered and utilized, as a matter of application specific design choice. 

NLMS, PNLMS and PNLMS++ 

As mentioned above, it is preferred to use fast converging algorithms to drive FIR 
10. Such algorithms may be, for example, NLMS and PNMLS, as set forth below: 

h n+ i = h n + xnen, NLMS (13) 

X n Xn + 5 

h n +i= h n + Gown. PNLMS (14) 

X n GnXn + 5 

where 

G n = d±ag{gbw;gL-i,n}> (15) 
is a diagonal matrix which adjusts the step-sizes of the individual taps of the filter 10, ju is 
the overall step-size parameter, and 8 is a regularization parameter which prevents 
division by zero. The diagonal elements of G n are calculated as follows 

L max = max{5 Pj \h^n- 1,| , . . \hL-\, n -\ }, (16) 
Yi = max{pL maX; | h^-i | }, 0 < i < L - 1, (17) 

Li = z = I>, (18) 

/=0 
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g\ = Yi/U 0 < i < L- 1 ? (19) 

Parameters hp and p are positive numbers with typical values hp =0.01, p=5/L. 
While these known fast converging algorithms are suitable in certain applications, 
an improvement over these two algorithms has been developed by personnel of the 
assignee called PNLMS++, which is set forth in An Efficient, Fast Converging Adaptive 
Filter For Network Echo Cancellation , published at Ascilomar Conference on Signal 
Systems and Computers, Nov. 1-4, 1998, Pacific Grove, Ca., which in essence combines 
NMLS and PNMLS by utilizing one or the other in alternate time steps in the matrix Q nj 
as set forth below: 

h n +l = h n + M GrCCnen, PNLMS++ (20) 

X n GnXn + 8 

G n = diag{go t n> »*,gL-l,n}> diagonal individual step-size matrix, (21) 
p is the overall step-size parameter and 8 is the regularization parameter that prevents 
division by zero. For odd-numbered samples the diagonal entries of the step-size matrix, 
G n are calculated as follows, which yields PNLMS; 

h max = max{^,|/20 9 «-i|,...,|/ii-i,n-i|}, (22) 

Y/,« = max {ph max, \h, » - i|},0 < / > L - 1, (23) 
gi y n = Yi B /&,»,0</<I-l. (24) 

i=o 

For even samples, 

G n = / (25) 


772508 


11 


BENESTY 2-1-6-13 

which results in an NLMS step. Parameters 5p = 0.01, and p are positive numbers with 
typical values Sp = 0.01, /?= 5/Z. 

PAPA 

Another type of known fast converging algorithm is the Affine Projection 
Algorithm (APA), which is a special case of NLMS, but recognizably faster. This may be 
combined with the proportional step size of PNLMS to yield a new, improved fast 
converging algorithm referred to herein as Proportional Affine Projection Algorithm 
(PAPA). This new algorithm is set forth below as: 

hn¥l = hn+fiGnKntXlXn+SIl-ien, (26) 
where G n is as defined in the last section and (X T n X n +8i)~ l , is an estimate of the inverse 
correlation matrix of the input signal, 

Ri = fe; S;"] - ' = (x T „x n +sir. (27) 

This matrix "whitens" the input data, X n , and thus the convergence rate of the 
adaptive filter is increased. With G n = 1, equation (26) reduces to the standard, known 
APA. As evident, and as mentioned above, PAPA is obtained by combining APA with 
the proportional step-size of PNLMS++. Note, however, that it is preferable to omit the 
matrix G n in the definition of Rxx,n to save computations. Inclusion of the matrix requires 
an additional 4L multiplications per sample, but it is believed that the effect on filter 
performance is minimal. Thus omission or inclusion of the matrix is an application 
specific matter of design choice. 
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Additionally, the choice of order of projection in the APA is governed by the 
properties of the input signal. For speech, an order of 6 to 10 would seem appropriate 
since it is known in the art that short term properties of speech are well modeled by an 
auto regressive process of that order. However, it is also known that choosing a low 
value for the order (e.g. 2) yields a practical algorithm with low complexity yet fast 
convergence rate. With an order of 2, it is also easy to maintain the numerical stability of 
the algorithm. 

As seen in FIGS. 1 and 3, a double talk detector (DTD) 30 is a part of echo 
canceller 1 and disables coefficient vector update device 40, albeit imperfectly. By way 
of example, a simple and efficient way of detecting double-talk in DTD 30 is to compare 
the magnitude of the far- and near-end signals and declare double-talk if the near-end 
magnitude becomes larger than a threshold value set by the far-end signal, (1). That is, if 

\yn\ > max {jx» |, |x«-l|, . . . ,|x»-i + i |, } (28) 

double-talk is declared. A so called hangover time, Tfo 0 id, is also included which means 
that if double-talk is detected, adaptation of the filter 10 is inhibited for this pre-specified 
duration beyond the end of double-talk. 

R-NLMS, R-PNLMS and R-PNLMS++ 

However, and as mentioned above, there is a finite period of time from the 
commencement of double-talk and the point when DTD 30 disables adaptation in 
coefficient vector update device 40. It is therefore desirable to make the aforementioned 
fast converging algorithms robust, i.e resistant to near end disturbances, whether 
introduced by undetected double talk or other system perturbations. 
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Specifically, both the NLMS algorithm and the PNLMS algorithm can be made 
robust to large disturbances by a modification of the optimization criterion on which 
these algorithms are based. Recall that the LMS is an iterative algorithm to adjust the 

estimated impulse response so as to minimize the cost function, E{\en\ 2 }, the mean square 
error. Each iteration updates the current estimate of h n , by [ix n e n , which is a step in the 
direction of a stochastic approximation to the gradient of E{\en\ }. To make the algorithm 
insensitive to changes of the level of input signal, x n the proportional factor x n is 
normalized, resulting in the NLMS algorithm in (13). It will be recognized by the person 
of skill, utilizing the teachings herein, that other gradient algorithms can be derived by 
changing the cost function to 

\e» I 

J(e n ) = E{qC—)} (29) 

s 

where g>Q, and hence Jfe^, is any symmetric function with a monotonically 
non-increasing derivative (with respect to its argument). More generally, one can use M- 

\en I 

estimators which are defined as Jfen) = X u q(- — ) . The choice used in (29) makes the 

s 

derivation of the iterative algorithm more consistent with the derivation of the LMS 
algorithm. In any case, the resulting algorithm, analogous to the steepest-descent method 
is 

h n + = h n - //v h J(e n ). (30) 
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The algorithm can be made robust by a proper choice of J(e n \ which must be chosen 
such that lim en _, J VhJ(e n ) I 4-oo. It is known that one might choose ^hJ( e n) = E{- 
\en\ 

x^signfe^ y/{- — L )s}, where ^is a hard limiter; 

s 

\en \en I 

= min{kO,(^}, (31) 
s s 

and s is a very important scale factor. The effect of this scale factor, and the manner in 

which it is adapted, is discussed further below. When the Gauss-Newton method is 

utilized to derive the iterative algorithm it is found that the inverse Hessian of the 

2 

minimization criterion (29) ({Vh should be used as a step-size matrix. The Hessian is 
straightforwardly found as 

v 2 h J(e n ) = E{^f^ (ti)}, = 4R XX , (32) 

s s s 

i.e. a constant (<;) times the correlation matrix (R X x) °f the input signal. This result comes 
from our choice of criterion, (12), whose derivative is either zero or one depending on the 
magnitude of ey/ s . The inverse of the correlation matrix is far too complex to be used for 
normalization so it is instead preferably approximated as a diagonal matrix, and use a 
stochastic approximation of the gradient is used, leading to the robust NLMS algorithm, 

a \ en | 

h n+1 = h n + xns y/Q )sign{e n } . (33) 

X n Xn + O S 

The PNLMS algorithm given in (2) can be made robust in an exactly analogous 
manner, yielding the update equation, 
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h n +i = h n + GnXnsy/Q )sign{e n }s. (34) 

X n GnXn + S S 

Alternating the iterations with Gn as given in (24) and (25) yields the robust 
PNLMS++ algorithm. 

The estimate of the scale factor, s, should reflect the background noise level at the 
near-end, be robust to shorter burst disturbances (double-talk) and track longer changes of 
the residual error (echo path changes). Therefore it is preferable to chose the scale factor 
estimate as, 

1-2 \ e » \ 

s n +i = Asn + sny/Q ), (35) 

J3 Sn 

so = av, 

which is very simple to implement. The choice of this method of estimating s is justified, 
as set forth further below. With this choice, the current estimate of s is governed by the 
level of the error signal in the immediate past over a time interval roughly equal to 1/(1 - 
X). When the algorithm has not yet converged, s is large. Hence the limiter is in its linear 
portion and therefore the robust algorithm behaves like the conventional NLMS or 
PNLMS algorithms. When double-talk occurs, the error is determined by the limiter and 
by the scale of the error signal during the recent past of the error signal before the double- 
talk occurs. Thus the divergence rate is reduced for a duration of about 1/(1 - X). This 
gives ample time for the DTD 30 to act. If there is a system change, the algorithm will 
not track immediately. As the scale estimator tracks the larger error signal the 
nonlinearity is scaled up and convergence rate accelerates. The trade off between 
robustness and tracking rate of the adaptive algorithm supplied by coefficient update 
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device 40 to FIR 10 is thus governed by the tracking rate of the scale estimator which is 
controlled by one single parameter, X. 

As mentioned above, a scale factor, s, can be found by defining the implicit 
function of s given by, 

J 2 (n) = J /ir , x(H) = 0, (36) 

where s is the scale factor, X\ , a forgetting factor. One may chose (♦) as, 

X(0 = ¥Q-fi, (37) 
because \y(-)is already calculated in (34). The choice of x(-) is also not very critical. 
For normalization, fiis chosen such that for a Gaussian process [z eN {0,1}], 

E{xi?)} = 0. 

This gives 


where 



This choice leads to a scale estimate s = Oy for Gaussian noise upon convergence. 
The purpose of the scale factor is multifold. Traditionally the scale is used to make a 
robust algorithm, e.g. (34), invariant to the background noise level. In this case the noise 
and the echo path to be identified are assumed stationary. In echo cancelling however, it 
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is desirable that the scale factor tracks nonstationary background noise as well as scales 
the nonlinearity appropriately so that the canceller is robust to double-talk bursts. 
Consequently the tracking rate of the scale estimator controls both convergence rate and 
robustness of the algorithm, (34). A recursive scale estimator is derived with a Gauss- 
Newton technique in the same fashion as the R-PNLMS-H- algorithm discussed above 
and further below. Thus let 

Sn + i = ^-(VJaCn))-^). (40) 


The gradient of (36) is 


t=0 s s s 


l — ) + bn-l 


s 2 S 


= — (41) 

S 


\en\ 

Let j2(n) = x(— ) and V s J(n) = V^fa) A recursive least squares type of algorithm then 

Sn 

becomes 

s n +i = s n+ — x{ J — - } (42) 

bn ^ 

\en\ \en\ 

bn+ l = Zlbn+^X'^}. (43) 

Sn Sn 

The complexity of this algorithm is reduced by using the following assumptions: 
VJ(n) is considered stationary and s n converges to the background standard deviation of 
the noise (Gaussian), then 


E{Vj2(n)} = £-^-£{i^x'(^)} (44) 


-» — - — -,n^>cc (45) 

S 1 -Al 
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1 2 -U 2 

a = J-(\-Q 2 ° (46) 


Combining (37), (40) and (45) leads to 


s n+ i = s„ + -^ —M—)-j3} (47) 

a Sn 


(1 - ^(1-2,))^ + ^ — M— ) (48) 

or or s n 


^ + (lzAMl-^^0) ? (49) 


1-^(1 - Ax). (50) 


Thus, as mentioned above, R-PNLMS++ is a robust algorithm that combines R- 
NLMS and R-PNLMS. That is, it uses the same step-size matrix G n as discussed above, 
and the coefficient update equation is 


min (51) 


Vfi = hn+ T GnXn<p(\en\sign{en} , R-PNLMS+++ (52) 

X n GnXn + S 

(I — X) 

s n +i = Asn + — — - <p(\en\), (53) 


where #(■) is a hardlimiter or Huber function and s n is a scale factor. The preferred 

function ip (|e«|)sign {e^} is shown in Fig. 4. kg and X are constants that control the 

robustness and convergence rate of the algorithm, p is chosen such that if the disturbing 
signal v n is zero-mean white Gaussian noise with variance o v , then s n -*ov, as n In 
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practice it may also be useful to bound the minimum value that s n can converge to. This 
value is referred to as s m j n and should preferably be chosen in the same range as o v . 

R-PNLMS++ SIMULATIONS 

Simulations of the above may be considered, by way of non-limiting example, to 
further set forth the preferred embodiments of the echo canceller 1 of the present 
invention and to exemplify the coupling between the DTD 30 and the coefficient vector 
update device 40 utilizing R-PNLMS++. In these exemplary simulations set forth below 
and in the referenced drawing figures, the known Geigel DTD is used. The exact 
coupling and settings of the DTD 30 and adaptive algorithms utilized by coefficient 
vector update device 40 are given in the following as well. In all the simulations, the 
sampling rate is 8 kHz. Two hangover times are used, one for the DTD, T^/j = 240 (30 
ms), and one for the scale factor Thold y scale = ^hold The reason for using a longer 
hangover time for the scale factor is to avoid undetected double-talk intervals, which may 
increase the divergence rate of the robust algorithms. Also, when the scale hangover 
counter (Count sca i e ,) is larger than zero, the scale factor is forced to approach a 
prespecified value, s m j n9 by the constant ip c ^s m i n $. s m i n is an estimate of the standard 
deviation background noise. It has the effect that robustness is maintained if double-talk 
goes on for a longer period of time. The double-talk detection hangover time is controlled 
by the variable Counthold, an exemplary form of calculating same being set for below: 

if |jto|> — max{| 1,..., |jc« - l + 1|}| or Countfooid > 0 

H = 0; 

i£(Counthold*®) 
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Counthold = 24 °5 
Countscale = 960; 

else 

Counthold = Counthold ~ U 
Count sca i e = Count sca i e - 1; 

end 


else 


|a = 0.2; 

if Count sca i e >0 

Count SC ale = Count SC ale - 1; 
end 

end 

Update eq. (15: R-PNLMS++, 

if Countscaie^ 0 ) 
fn = sign (e n )min{ s»} ; 

s n +\=Zs» + — y/n\ (54) 

else 

, Jfco(l-A 

^ n +l = Asn + Wc 

end 

The DTD 30 and scale estimator could share the same hangover counter. 
Estimating the scale s as shown above in equation in (54) instead of (35) reduces 
complexity. Exemplary extra computations for introducing robustness are given in FIG. 5. 
This amounts to less than 0.3% of the total load for a PNLMS++ algorithm with £ = 512. 

R-PNLMS++ EXPERIMENT 

Experiments were carried out utilizing NLMS, PNLMS and R-PNLMS++ to show 
the performance improvements that may be realized utilizing a preferred robust fast 
converging algorithm such as R-PNLMS++ in coefficient vector update device 40. 

The three algorithms, NLMS, PNLMS++ and R-PNLMS++ are evaluated using 
white Gaussian noise as signals. An example of the performance for a speech signal is 
also shown. General parameter settings are 

772508 21 


BENESTY 2-1-6-13 


\x = 0.2, L = 512 (64 ms), 5 = 20000, S p = 0.01, p - -0.01 

a x = 1900, SNR - 39 dB (echo-to-noise ratio). 

All three algorithms achieve a minimum mean square error 
of -49 dB. 

Hybrid attenuation: 20 dB. 

a Geigel detector assumes 6 dB attenuation. 

Two sets of parameters for the robust algorithm are shown, 
{XJko) = (0.997, 1.1) (0.995, 1.5). These choices result in 
[p * 0.73927, (X = 0.996)]. 


FIG. 6 shows the impulse response, h e p(l), I = 0, and the amplitude function of 
the sparse hybrid used in the simulations. Four kinds of experiments are carried out in 
order to illuminate the operation of the R-PNLMS++ versus PNLMS++ and NLMS 
during double-talk, re-convergence and continuous tracking. As performance measures, 
the misalignment and mean square-error (MSE) are used, 


Misalignment (n) 


MSE(n) 


\\hep ~ hn\\ 

101ogio{L— JL}, 


■ep\ 


{yn-vn-h n xn > 
10 logjo { ; 3 }, 


(55) 


(56) 


The average, < >, is taken over about 1000 samples. This length of averaging is necessary 
in order to reduce the variance in the figures and it does not significantly affect the 
convergence rate in the figures. 
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(i) Double-talk bursts with the DTD either switched off or on 

Half-second bursts of double-talk are introduced at times 3, 6, and 9 seconds of 
levels 30, 6, and 0 dB, respectively, below the far-end speech. FIG. 7 shows the far- and 
near-end signals and the misalignment for parameter setting X = 0.997 and ko = 1.1. The 
divergence rates of the algorithms do not strongly depend on the power of the near-end 
signal. Even when the DTD 30 is used as in FIG. 7c, PNLMS++ and NLMS diverge at 
both 6 and 9 s. The DTD 30 does not inhibit adaptation until 122 samples of double-talk 
have entered the algorithms (at 6 s) and this is enough to drive the filters far from their 
optimal setting. R-PNLMS++ is not affected by these samples. A number of detection 
misses between 3 - 3.5 s slightly perturbs the robust estimate. At 9 s, the DTD 30 reacts 
fast at the start of double-talk but makes a detection error only a few samples long after 
the first hangover time. This detection error causes the non robust algorithms to diverge. 
The R-PNLMS++ is not influenced by the detection error occurring between 9 - 9.5 s. 

Results for the parameter setting A = 0.997 and ko = 1.5 are presented in FIG. 8. 
In this case the R-PNLMS++ is less robust as clearly seen at 6 s, in FIG. 8b. Divergence 
due to double-talk detection errors is larger than in the previous case. However, when the 
DTD 30 makes fewer mistakes, the divergence of the R-PNLMS++ is insignificant as 
seen between 9 - 9.5 s. 

An example of the performance during double-talk when speech is used is shown 
in FIGS. 9 and 10. The far-end speaker is female and the near-end speaker is male, and 
the average far- to near-end ratio is 6 dB. R-PNLMS++ performs considerably better 
during double-talk. For the second choice of parameters, (0.995, 1.5), a large number of 
DTD misses eventually affect the hybrid estimate. Observe that the misalignment does 


772508 


23 


BENESTY 2-1-6-13 

not decrease immediately after double-talk stops while the mean square error does. This 
is because some modes of the adaptive filter are poorly excitated by the far-end speech at 
3.5 s. 

(ii) Convergence after abrupt hybrid change 

Three cases of hybrid changes are tested, 

A. hi •* -hi-200 at 3 * (Practical case). 

B. -hi-200 * ~ h U200 ® t6s ("Best" case for PNLMS++). 

C. hi„200 ->-hl-200> /= 0...39, - hu200 I = 40 ,..311 at 9 s, ("Worst" 
PNLMS++). 

The price paid for robustness a ainst double-talk is slower reconvergence after 
abrupt hybrid changes which can be seen in FIG. 11. The difference between PNLMS++ 
and R-PNLIMS++ can be made fairly small, FIG. lib. R-PNLMS++ performs better 
than NLMS in cases A and B for both parameter settings but is somewhat slower for case 
C. The performance loss for re-convergence of the robust algorithm is minor. FIGS. 12 
and 13 summarize the divergence and convergence time of the algorithms where 
divergence/convergence time is defined as the time it takes for the algorithm to 
increase/decrease misalignment by 20 dB. 

(iii) Tracking a slowly changing hybrid 
• h/ -hj_io gradually between 3 - 4 s. 

Results from tracking a continuously changing hybrid are presented in FIG. 14. 
The hybrid changes slowly over a period of 1 s. R-PNLMS++ and PNLMS++ track 
equally well while NLMS performs poorer. The impact of the non-linearity in this test is 
insignificant. 
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R-PAPA 

As mentioned above, utilization of PLNMS in coefficient vector update device 40 
does not take into account the fact that the speech signal is a correlated signal. Taking 
this into account can further increase convergence, specifically by utilizing APA and 
making it robust. 

Considering all of the above, a robust version of PAPA (and hence of APA) is 
obtained straightforwardly, as set forth below: 

<p§en\) = min len^^o}, (57) 
h w +7 = hn + MGrfinR^in)]^ (58) 

s n +] = As n + ^-^<p(\ein\) (59) 
In (58) O denotes elementwise multiplications. 

Additionally some of the computational procedures of the Fast Affine Projection 
(FAP) algorithm, , can be incorporated in order to reduce the computational complexity 
of APA and PAPA. The elements of the correlation matrix can be updated recursively. 
Thus, if we define: 

ril,0 = H 1,-1= $ ( 6 °) 

ri2,0 = ft ( 61 ) 

(62) 

then 

r22,n = r ll,n-l ( 63 ) 
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Hl,n = ni,n-l+x 2 n-*l-L ( 64 ) 

ril,n = r]2,n-l+XnXn-l~Xn-L*n-L-l' ( 65 ) 
The calculation of the error vector in APA (11) can be approximated as follows, 

e n = d n -x T n h n _i (66) 

e n = [en{[~ ju)ein~iY ^ (67) 
which reduces the calculations needed by L - 1 multiplies. The complexity of the APA 
algorithm can be reduced further by introducing an alternative coefficient vector, h n 
mentioned in eq. (9). Unfortunately, this cannot be done in PAPA, because invariance of 
the product of the step-size matrix and the excitation vector is destroyed since G n varies 
from one iteration to the next. Shown (Al through A22) below are exemplary fast 
versions of the robust APA and proportional APA. Adaptation is preferably inhibited by 
double-talk detector 30 which also controls the updating of the scale factor s n utilized by 
adaptive scaled non-linearity device 50. In the exemplary simulations discussed further 
herein, a Geigel DTD has been used which is given by, 

if\y n | > 9 max{|x„ |, \x n „ x |,..., \x n _ L+l | } or Counthold > 0 
// = 0; 

if (Counthold ^ 0) 

Counthold = Thold 
Count sca i e = Thold, scale \ 

else 

Counthold = Counthold ~ 1 
Count sca j e = Count sca i e -1; 

end 
else 
// = 0.2; 

if Count sca \ Q > 0 

Count scz \Q = Count -1; 
end 
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end 


Thoid is a hangover time for adaptation and 7hold,scale is the hangover time for 
the scale factor. The director threshold, 0 = 0.5, if we assume 6 dB of hybrid attenuation 
and ff « 0.71 for a 3 dB assumption. 
Robust APA 


r22,n 


[ E l,n E 2,J 7 


0 


ril,n-l 


ril,n-l+x 2 n -xt_ L 


ri2,n = rl2, n -l+XnX n .]-x n .Lx n -L-l 


(A5) 

c n = dn-* T n K-l 
e„ =z-Vri2,nHn 

r(H)= min {kl>v«} 

e n = [sign(e n Vje„ |)] (l - U -i ] 7 


E n - 


J \.n 


+ R e « 


(Al) 
(A2) 
(A3) 
(A4) 

(A6) 
(A7) 
(A8) 

(A9) 
(A10) 


h n = 


(All) 

if {Count sca i e < 0) 


else 


(A12) 
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S n + 1 = ASn + (l - X)s min (Al 3) 

end 

Robust PAPA 

m,n = ru,n-l ( A14 ) 

m,n = m,n-l +x 2 „ - x 2 n _ L (A15) 

ri2,n = ri2, n -l + xnx n -l -Xn-LXn-L-1 
(A16) 

en = d n -x T „h n .] (A17) 

y(jen|) = min s«fc>} (A18) 

e« = [^(enMHXl-^ei.n-if (A19) 

h„ = h„.x^^+/iG«M> (A20) 
if {Count sca i e < 0) 

%+i = + (A21) 


else 


= ASn + (1 - min (A22) 


end 


where s m i n is a preset constant. S m i n is the assumed minimum background power level of 
the noise. Inversion of the correlation matrix H X x,n * s preferably made with Gaussian 
elimination. Using this technique of the robust APA requires 21 + 13 multiplies and 3 
divisions, and robust PAPA requires 4L + 12 multiplies and 3 divisions. The individual 
step-size matrix G n is given by (22) to (25) above. 
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R-PAPA SIMULATIONS 

In the following simulations we compare the performance of six algorithms, 
R-PNLMS++, PNLMS++, R-APA, APA, R-PAPA and PAPA. 

The purpose of these simulations is to show the excellent performance of the 

robust algorithms during double-talk and the high convergence rate of the robust PAPA 

and PAPA algorithms when speech is used as excitation signal. With a projection order of 

2, an input signal having the properties of an AR{1} process can be perfectly whitened 

and maximum improvement of the convergence rate is achieved. Speech, however, is not 

an AR{1} process but can be fairly well modeled by an 8th order AR process. An order 

of 2 is preferably chosen as a compromise between complexity and performance. The 

parameter settings chosen for the following simulations are: 

p = 51 L has been recommended for PNLMS. However, for PNLMS ++ a 
smaller value can be used resulting in lower sensitivity to different 
impulse responses. \x = 0.2, L = 512 (64 ms), 5 = 2.10 5 (R-PNLMS++ and 
PNLMS++), 5-1 10 6 (R-APA, APA, R-PAPA and PAPA), 8 P = 0.01, p 
- 0.001 1 

6 X = 1 900, SNR= 39 dB (echo-to-noise ratio). 

• Average far-end to double-talk ratio is 6 dB. 

• Hybrid attenuation: 20 dB. 

• Geigel detector assumes 6 dB attenuation. 

Parameters for the robust algorithm are, (A, k 0 ) = (0.997, 1.1). This choice results 
in 0 -,Z~ 0.60665. s m i n = 2, so = 1000. 

h 0 = 0 

Impulse response and corresponding magnitude function of the test hybrid is 
shown in FIG. 6 
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FIGS. 15-18 show far-end signal, double-talk and the misalignment of the six 
algorithms. The sequence of double-talk starts at different times in the four simulations 
thus showing the reliable performance of the robust algorithm for different double-talk 
situations. The principle of robustness works at all stages of convergence of the 
algorithms. Thus, as seen in FIG. 18, the algorithms (R-PNLMS++, R-APA, R-PAPA) 
resist divergence during double-talk even though they have not yet fully converged. This 
is due to the adaptive scale factor. Initial convergence rates of the PAPA and R-PAPA are 
superior to the other algorithms. FIG. 19 shows the behavior after an abrupt system 
change where the impulse response is shifted 200 samples at 1 second. It is can thus be 
seen that PAPA and R-PAPA are the fastest converging algorithms. Note that the robust 
PAPA converges even faster than PNLMS++. 

R-PAPA EXPERIMENTS - Composite Source Signal as Excitation Signal 

As is known, ITU-T G.168 recommends certain test procedures for evaluating the 
performance of echo cancelers. Test signals used are the so called Composite Source 
Signals (CSS) that have properties similar to those of speech with both voiced and 
unvoiced sequences as well as pauses. This section presents the results from two test 
situations evaluating the performance during double-talk, the so called Test 3A and Test 
3B. In Test 3A the double-talk sequence is of low level, i.e. 15 dB, below the far-end 
signal. It is of course recognized that a Geigel DTD assuming 6 dB attenuation is not 
able to detect this "double-talk". However, in some cases where the instantaneous far-end 
level is low and the near-end level is high, the DTD may inhibit adaptation. Test 3B 
evaluates the performance of the echo canceller 10 for a high level double-talk sequence. 
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The double-talk level in this case is about the same as that of the far-end signal, thus a 
fixed threshold Geigel DTD assuming 6 dB attenuation is able to detect this double-talk. 
False alarms and failures to detect double-talk are influenced by the chosen threshold in 
the DTD and the attenuation in the hybrid. Three hybrid attenuations are therefore 
evaluated. The parameter and initial value settings for both conducted tests are 

p = 0.2, L = 512 (64 ms), 6 = 2 - 10 5 (R-PNLMS++ and PNLMS++), 6 = 1 - 10 s 
(R-APA, APA, R-PAPA and PAPA), 6 p = 0.01, p= 0.001 

Parameters for the robust algorithm are, (X, k 0 ) = (0.9975, 1 .5). This choice results 
in p * 0.73927, s min = 10, so = 1000. 

b x = 1 .3 - 1 0 4 , SNR 37 dB (echo-to-PCM quantization noise ratio). 

• Hybrid attenuations: 6, 8, 1 1 dB. 

• Geigel detect or assumes 3 dB attenuation. 
h 0 = 0. 

Multiple tests were carried out using three kinds of hybrids, a sparse, a dispersive 
and a multireflection system. FIG. 20 shows these impulse responses and their magnitude 
functions. Far- and near-end signals (CSS) used in Test 3 A are shown in FIG. 21. 
During the first 625 ms the far-end signal is white noise and the near-end signal is zero. 
This drives the echo canceller 10 to an initial state with zero coefficients and the 
excitation vector is filled with non-zeros samples. The settings of initial variables do not 
influence the convergence rate hence the "true" convergence rate is seen when adaptation 
begins at 625 ms. FIGS. 22 - 26 show that for the parameter settings chosen, the change 
of hybrid attenuation does not seem to influence the performance of the algorithms. 
PAPA and R-PAPA are least sensitive to changes of sparseness of the responses, as 
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recognized by comparing FIG. 22 and 24. These algorithms have superior convergence 
rate compared to the others. All robust algorithms have better average steady-state 
performance (i.e. their average, misalignments are lower) than their respective non-robust 
versions. 

Far- and near-end signals used in Test 3B are shown in Fig. 16. Double-talk starts 
after about 12 seconds. Misalignments of the six algorithms are shown in FIGS. 28 - 32. 
All three robust algorithms handle the double-talk period without any degradation of 
misalignment while non-robust algorithms, despite the Geigel detector, diverge up to 30 
dB. This divergence occurs when the DTD falls to detect the double-talk and as few as 
three samples are enough to drive the hybrid estimate far from optimum. The lengths of 
undetected bursts in these simulations range from a few up to a couple of hundred 
samples. The difference in convergence rate between the algorithms is also more clearly 
seen in this example. 

Thus, based upon the above, the person of skill will recognize that the appropriate 
variables can be adjusted to accommodate differing application needs. For example, to 
increase robustness, one could increase X and decrease k 0 . To increase the speed of 
convergence, decrease X and increase k Q . Moreover, it will also be recognized that the 
present invention will still provide fast convergence and robustness in the event that 
perturbations are caused by changes in the system to which it is applied, such as changes 
in the filter characteristic of the device that the fast impulse response filter is trying to 
emulate and cancel. 

It will be further recognized by those of skill in the art that the system of FIGS. 1- 
3 and/or components thereof can be implemented on a general purpose digital computer 
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using appropriate software to provide updating of the coefficients as shown herein and 
other digital filtering and processing functions. Alternatively, the system or its individual 
components may be implemented on one or more integrated circuits chips having 
software burned or stored therein for providing the functionality herein described. In a 
preferred embodiment, the device is a programmable integrated circuit or a programmable 
logic array. Of course, it will be recognized, that the entire circuit of FIGS. 1-3 or parts 
thereof may also be implemented in a digital signal processor (DSP), that could perform 
all or part of the functions described herein. Moreover, while the inventive system 
described and shown herein has been described in the context of a telephone network, it 
will be recognized by those of skill in the art that such signal processing techniques can 
be applied in other fields of endeavor, such as analog and/or digital audio or video, noise 
cancellation, telephone instruments, conference telephones, radio frequency microwave 
or optical communications, or any other field of endeavor requiring adaptive filtering. 

Thus, while there have been shown and described and pointed out fundamental 
novel features of the invention as applied to preferred embodiments thereof, it will be 
understood that various omissions and substitutions and changes in the form and details 
of the disclosed invention may be made by those skilled in the art without departing from 
the spirit of the invention. It is the intention, therefore, to be limited only as indicated by 
the scope of the claims appended hereto. 
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CLAIMS 


What is claimed is: 


1 . A robust adaptive filter comprising: 
a fast impulse response filter; 

a coefficient vector update device connected to saMTast impulse response 
filter for feeding adaptive coefficients thereto in response to a received error signal; and 

a modifying device for modifying said adaptive coefficients by application 
of an adaptive scaled non-linearity. 

2. A robust adaptive filter comprising: 

an adaptive filter utilizing a fast converging adaptive algorithm; and 
means for modifying said algorithm by the application thereto of an 
adaptive scaled non-linearity. 

3. The filter of claim 2, wherein the fast converging algorithm is PNLMS. 

4. The filter of claim2/wherein the fast converging algorithm is PNLMS++. 

5. The filter of claim 2, wherein the fast converging algorithm is APA. 

6. The filter of claim ^wherein the fast converging algorithm is PAPA. 

7. The filter of claim S/wherein the adaptive scaled non-linearity is given by 

\e n | ^ 

Y( ) sign 

s 

8. The filter of claim 4 ? wherein the adaptive scaled non-linearity is given by 


) sign 

s 
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9. The filter of claim 5, wherein the adaptive scaled non-linearity is given by 


r" I 

!P( ) sign {e n }s n . 

s 

10. The filter of claim 6, wherein the adaptive scaled non-linearity is given by 

r" I — 

!P( )sign {e n }s n . 

s 

11. A robust echo canceller for use in a telephone circuit, comprising: 

an adaptive filter connected to said telephone circuit for outputting an 
error signal corresponding to a detected echo signal; 

a vector coefficient update device connected to said filter for feeding 
adaptive filter coefficients thereto in response to a modified error signal; and 

a device for modifying said adaptive coefficients by modifying said error 
signal through the application of an adaptive scaled non-linearity to said error 
signal to generate said modified error signal. 

12. The echo canceller of claim 11, further comprising a double talk detector 
connected to said telephone circuit for disabling said update device in response to 
the detection of double talk on said circuit. 

13. A robust echo canceller comprising: 

an adaptive filter for outputting an error signal in response to a detected 
echo signal; and 

means for supplying adaptive filter coefficients to said filter, wherein said 
filter coefficients are given by h n +] = h n + — — — GnXn<p(\en\sign{en} , . 

X„ GnXn + 8 
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14. The echo canceller of claim 13, further comprising a double talk detector 
connected to said telephone circukfor disabling said update device in response to 
the detection of double talk on said circuit. 

15. A robust echo canceller comprising: 

an adaptive filter for outputting an error signal in response to a 
detected echo signal; and 

means for supplying adaptive filter coefficients to said filter, wherein said 

filter coefficients are given by h n + ] = h n + /uG^nR ^ (n) 

144° 

16. The echo canceller of claim 15, further comprising a double talk detector 
connected to said telephone circuit for disabling said update device in response to 
the detection of double talk on said circuit. 


36 


BENESTY 2-1-6-13 

ABSTRACT OF THE DISCLOSURE 

A robust adaptive filter for use in a network echo canceller or other digital 
signal processing application utilizes a coefficient vector update device that, through the 
application of fast converging algorithms to a fast impulse response filter yields fast 
convergence of the adaptive filter's characteristics with the avoidance of divergence due 
to the onset of double talk. Robustness is also provided, via an adaptive scale non- 
linearity device which applies an adaptive scale non-linearity to the filter algorithms fed 
to the fast impulse response filter by the coefficient vector update device, so that the 
samples of an echo signal to be cancelled which are taken during the onset of double talk 
can be handled in such a manner that after the double talk detector causes adaptation to 
cease, the initial, potentially disturbing samples do not cause significant divergence in the 
filter system. 
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Figure 3: (a) Impulse response and (b) magnitude of the frequency response of the hybrid. 
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Figure 4: Performance during double-talk for parameter setting A = 0.997, A* = 1.1 (a) Far- and 
near-end signals. Far- to near-end ratio: 30 dB (3 - 3-5 *), 6 dB (6 - 6.5 *), 0 dB (9 - 9.5 a), (b) 
Misalignment without double-talk detector, (c) Misalignment with double-talk detector. Solid line: 
R-PNLMS++, Dashed line: PNLMS++, Dotted line: NLMS. The small vertical bars indicate when 
double-talk is declared. 




■ u Figure 5: Performance during double-talk for parameter setting A = 0.995, k 0 — 1.5. Far- to near- 
!U end ratio: 30 dB (3-3-5 s), 6 dB (6-6,5 s), 0 dB (9-9.5 s). (a) Misalignment without double-talk 
jj detector, (b) Misalignment with double-talk detector. Solid line: R-PNLMS++, Dashed line: 
h PNLMS++, Dotted line: NLMS. The small vertical bars indicate when double-talk is declared. 
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•Figure 6: Double-talk, speech signal, (a) Far- and near-end signals. Average far- to near-end ratio: 
6 dB (1.125-3.125 s). (b) Misalignment, A = 0.997, ko = 1.1. (c) Misalignment, A = 0.995, A* = 1.5. 
Solid hne: R-PNLMS++, Dashed line: PNLMS++, Dotted line: NLMS. 
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^ Figure 7: Double-talk, speech signal as in Fig. 6a. (a) shows MSE when A = 0.997, ko = 1.1. (b) 
•U shows MSE when A = 0.995, h = 1.5. Solid line: R-PNLMS++, Dashed line: PNLMS++, Dotted 
!;J line: NLMS. 
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Figure 8: Reconvergence after abrupt hybrid changes. Case A at 3 s, Case B at 6 s and Case 
C at 9 s. (See Section 4.2.2 for a definition the three conditions), (a) A = 0.997, k 0 = 1-1 0>) 
A = 0.995, Ar 0 = 1.5. Solid line: R-PNLMS++, Dashed line: PNLMS++, Dotted line: NLMS. 
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Figure 11: Misalignment when tracking a nonstationary hybrid, 3 - 4 s. (a) A = 0,997, Jfco = 1.1- 
(b) A = 0.995, ko = 1.5. Solid line: R-PNLMS++, Dashed line: PNLMS++, Dotted line: NLMS. 
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Figure 4- Misalignment during double-talk starting at 1.25 seconds. Far- to near-end ratio: 6 dB. (a) 
Far (upper) and near-end (lower) signals, (b) Solid line: R-PNLMS++, Dotted line: PNLMS++- 
(c) Solid line: R-APA, Dotted line: APA. (d) Solid line: R-PAPA, Dotted line: PAPA. 
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Figure 5: Misalignment during double-talk starting at 2.25 seconds. Fax- to neax-end ratio: 6 dB. (a) 
Far (upper) and near-end (lower) signals, (b) Solid line: R-PNLMS++, Dotted line: PNLMS++. 
(c) Solid line: R-APA, Dotted line: APA. (d) Solid line: R-PAPA, Dotted line: PAPA. 



Figure 6: Misalignment during double-talk starting at 2.75 seconds. Far- to near-end ratio: 6 dB. (a) 
Far (upper) and near-end (lower) signals, (b) Solid line: R-PNLMS++, Dotted line: PNLMS++. 
(c) Solid line: R-APA, Dotted line: APA. (d) Solid line: R-PAPA, Dotted line: PAPA. 



Figure 7: Misalignment during double-talk starting at 0.25 seconds. Far- to near-end ratio: 6 dB. (a) 
Fa? (upper) and near-end (lower) signals, (b) Solid line: R-PNLMS++, Dotted line: PNLMS+4, 
(c) Solid line: R-APA, Dotted line: APA. (d) Solid line: R-PAPA, Dotted line: PAPA. 
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Figure 8: Misalignment after abrupt hybrid change occurring at 1 second, (a) Far (upper) and 
near-end (lower) signals, (b) Solid line: R-PNLMS++, Dotted line: PNLMS+-K (c) Solid line: 
R-APA, Dotted line: APA. (d) Solid line: R-PAPA, Dotted line: PAPA. 



Figure 9: The three hybrids is Test 3a and Test 3b. (a, c, e) Impulse responses, (b, d, f) Corre- 
sponding magnitudes of the frequency responses. 
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Figure 10: Signal for Test 3a. (a) Far-end signal, (b) Echo and near-end signal, (c) Near-end signal. 
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Figure 11: Misalignment Test 3a, hybrid in Fig. 9a (sparse) with 8 dB attenuation, (a) Solid line: 
Robust PNLMS++, dashed line: PNLMS++. (b) Solid line: Robust APA, dashed line: APA. (c) 
Solid line: Robust PAPA, dashed line: PAPA. 
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Figure 12: Misalignment Test 3a, hybrid in Fig. 9a (sparse) with 6 dB attenuation, (a) Solid line: 
Robust PNLMS++, dashed line: PNLMS++. (b) Solid line: Robust APA, dashed line: APA (c) 
Solid line: Robust PAPA, dashed line: PAPA. 
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Figure 13: Misalignment Test 3a, hybrid in Fig. 9c (dispersive) with 8 dB attenuation, (a) Solid 
line: Robust PNLMS-h-h, dashed line: PNLMS-h-K (b) Solid line: Robust APA, dashed line: APA. 
(c) Solid line: Robust PAPA, dashed line: PAPA. 
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Figure 14: Misalignment Test 3a, hybrid in Fig. 9c (dispersive) with 6 dB attenuation, (a) Solid 
line: Robust PNLMS++, dashed line: PNLMS++. (b) Solid line: Robust APA, dashed line: APA 
(c) Solid line: Robust PAPA, dashed line: PAPA. 



Figure 15: Misalignment Test 3a, hybrid in Fig. 9e (three short reflections) with 11 dB attenuation, 
(a) Solid line: Robust PNLMS++, dashed line: PNLMS++. (b) Solid line: Robust APA, dashed 
line: APA. (c) Solid line: Robust PAPA, dashed line: PAPA. 
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Figure 16: Signal for Test 3b. (a) Fax-end signal, (b) Echo and near-end signal, (c) Near-end signal. 
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Figure 17: Misalignment Test 3b, hybrid in Fig. 9a (sparse) with 8 dB attenuation, (a) Solid line: 
Robust PNLMS++, dashed line: PNLMS++. (b) Solid line: Robust APA, dashed line: APA. (c) 
Solid line: Robust PAPA, dashed line: PAPA. 



Figure 18: Misalignment Test 3b, hybrid in Fig. 9a (sparse) with 6 dB attenuation, (a) Solid line: 
Robust PNLMS++ , dashed line: PNLMS++. (b) Solid line: Robust APA, dashed line: APA. (c) 
Solid line: Robust PAPA, dashed line: PAPA. 



Figure 19: Misalignment Test 3b, hybrid in Fig. 9c (dispersive) with 8 dB attenuation, (a) Solid 
line: Robust PNLMS++, dashed line: PNLMS++. (b) Solid line: Robust APA, dashed line: APA. 
(c) Solid line: Robust PAPA, dashed line: PAPA. 



Figure 20: Misalignment Test 3b, hybrid in Fig. 9c (dispersive) with 6 dB attenuation, (a) Solid 
line: Robust PNLMS++, dashed line: PNLMS++. (b) Solid line: Robust APA, dashed line: APA. 
(c) Solid line: Robust PAPA, dashed line: PAPA. 
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Figure 21: Misalignment Test 3b, hybrid in Fig. 9e (three short reflections) with 11 dB attenuation, 
(a) Solid line: Robust PNLMS++, dashed line: PNLMS++. (b) Solid line: Robust APA, dashed 
line: APA. (c) Solid line: Robust PAPA, dashed line: PAPA. 
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IN THE UNITED STATES 
PATENT AND TRADEMARK OFFICE 

Declaration and Power of Attorney 
As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name. 

I believe I am the original, first and joint inventor of the subject matter which is claimed 
and for which a patent is sought on the invention entitled ADAPTIVE FILTER FOR NETWORK 
ECHO CANCELLATION the specification of which is attached hereto. 

I hereby state that I have reviewed and understand the contents of the above identified 
specification, including the claims, as amended by an amendment, if any, specifically referred to 
in this oath or declaration. 

I acknowledge the duty to disclose all information known to me which is material to 
patentability as defined in Title 37, Code of Federal Regulations, 1.56. 

I hereby claim foreign priority benefits under Title 35, United States Code, 119 of any 
foreign application(s) for patent or inventor's certificate listed below and have also identified 
below any foreign application for patent or inventor's certificate having a filing date before that 
of the application on which priority is claimed: 

None 

I hereby claim the benefit under Title 35, United States Code, 120 of any United States 
application(s) listed below and, insofar as the subject matter of each of the claims of this 
application is not disclosed in the prior United States application in the manner provided by the 
first paragraph of Title 35, United States Code, 112, I acknowledge the duty to disclose all 
information known to me to be material to patentability as defined in Title 37, Code of Federal 
Regulations, 1.56 which became available between the filing date of the prior application and 
the national or PCT international filing date of this application: 

None 

I hereby declare that all statements made herein of my own knowledge are true and that 
all statements made on information and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false statements and the like so made are 
punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the United States 
Code and that such willful false statements may jeopardize the validity of the application or any 
patent issued thereon. 
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I hereby appoint the following attorney(s) with full power of substitution and revocation, 
to prosecute said application, to make alterations and amendments therein, to receive the 
patent, and to transact all business in the Patent and Trademark Office connected therewith: 

Lester H. Birnbaum (Reg. No. 25830) 

Richard J. Botos (Reg. No. 32016) 

Jeffery J. Brosemer (Reg. No. 36096) 

Kenneth M. Brown (Reg. No. 37590) 

Donald P. Dinella (Reg. No. 39961) 

Guy Eriksen (Reg. No. P-41736) 

Martin I. Finston (Reg. No. 31613) 

James H. Fox (Reg. No. 29379) 

Barry H. Freedman (Reg. No. 26166) 

Julio A. Garceran (Reg. No. 37138) 

Mony R. Ghose (Reg. No. 38159) 

Jimmy Goo (Reg. No. 36528) 

Anthony Grillo (Reg. No. 36535) 

Stephen M. Gurey (Reg. No. 27336) 

John M. Harman (Reg. No. 38173) 

Donald E. Hayes, Jr. (Reg. No. 33245) 

John W. Hayes (Reg. No. 33900) 

Mark A. Kurisko (Reg. No. 38944) 

Irena Lager (Reg. No. 39260) 

Christopher N. Malvone (Reg. No. 34866) 

Scott W. McLellan (Reg. No. 30776) 

Martin G. Meder (Reg. No. 34674) 

Geraldine Monteleone (Reg. No. 40097) 

John C. Moran (Reg. No. 30782) 

Michael A. Morra (Reg. No. 28975) 

Gregory J. Murgia (Reg. No. 41209) 

Claude R. Narcisse (Reg. No. 38979) 

Joseph J. Opalach (Reg. No. 36229) 

Neil R. Ormos (Reg. No. 35309) 

Eugen E. Pacher (Reg. No. 29964) 

Jack R. Penrod (Reg. No. 31864) 

Daniel J. Piotrowski (Reg. No. P-42079) 

Gregory C. Ranieri (Reg. No. 29695) 

Scott J. Rittman (Reg. No. 39010) 

Eugene J. Rosenthal (Reg. No. 36658) 

Bruce S. Schneider (Reg. No. 27949) 

Ronald D. Slusky (Reg. No. 26585) 

David L. Smith (Reg. No. 30592) 

Patricia A. Verlangieri (Reg. No. P-42201) 

John P. Veschi (Reg. No. 39058) 

David Volejnicek (Reg. No. 29355) 

Charles L. Warren (Reg. No. 27407) 

Eli Weiss (Reg. No. 17765) 
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I hereby appoint the attorney(s) on ATTACHMENT A as associate attorney(s) in the 
aforementioned application, with full power solely to prosecute said application, to make 
alterations and amendments therein, to receive the patent, and to transact all business in the 
Patent and Trademark Office connected with the prosecution of said application. No other 
powers are granted to such associate attorney(s) and such associate attorney(s) are 
specifically denied any power of substitution or revocation. 


Full name of 1st joint inventor: Jacob Benesty 

Inventor's signature V ^ Date 0^. (T t i? $f 

Residence: 20 Shadyside Avenue, County of Union, Summit, New Jersey 07901 
Citizenship: Morocco 

Post Office Address: 20 Shadyside Avenue 

Summit, New Jersey 07901 

Full name of 2nd joint inventor: Tomas Fritz Gaensler 

Inventor's signature *ytf)H&<J f /^7</Z? d^h^Qs€*~^ p a te 

Residence: 1 12 Washington Rock Road, County of Somerset, Watchung, New Jersey 07060 

Citizenship: Sweden 

Post Office Address: 112 Washington Rock Road 
Watchung, New Jersey 07060 
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Full name of 3rd joint ij 
Inventor's signature 
Residence: 28 Ann PnaH nnunty 
Citizenship: USA 

Post Office Address: 28 Ann Road 

Long Valley, New Jersey 07853 


Full name of 4th joint inventor: Man Mohan Sondhi 

Inventor's signature $>e»AL^ Date &\^\^ 

Residence: 105 Intervale Road, County of Morris, Mountain Lakes, New Jersey 07046 
Citizenship: USA 

Post Office Address: 105 Intervale Road 

Mountain Lakes, New Jersey 07046 
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ATTACHMENT A 


Attorney Name(s): James J. DeCario Reg. No.: 36,120 

Steven B. Pokotilow Reg. No.: 26,405 

Lawrence Rosenthal Reg. No.: 24,377 

Howard M. Gitten Reg. No.: 32,138 

Matthew W. Siegal Reg. No.: 32,941 


Telephone calls should be made to James J. DeCario at: 
Phone No.: 212-806-5742 
Fax No.: 212-806-6006 
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